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ABSTRACT 

The definition and purposes of evaluation are 
explained in this booklet addressed to members of boards of 
education* Evaluation provides information to the school boa^d 
enabling them to make decisions about goals, personnel, 
administrators, and programs* Some guidelines are offered regarding 
responsibility in personnel and student evaluation* (SM) 
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PREFACE 



This booklet has been prepared by 
the Capitol Region Education Council 
to provide Boards of education with 
some basic information about evalua- 
tion in education. 

The contents of this booklet 
focus more on the "(flkat" and "iHhy" 
of evaluation, than on the '*Motu." 
There are many materials at CREC 
which provide more detailed infor- 
mation on the process involved in 
carrying out an evaluation. Con- 
sultant help is also available at 
CREC. 

The topic of evaluation is com- 
plex. A booklet of this nature is 
not meant to provide a comprehen- 
sive picture of evaluation. This 
booklet is concerned with some ques- 
tions on evaluation raised by some 
Board members. 

Readers needing or wanting more 
detailed information are referred to 
the CREC Evaluation Center. 



To the Members of Boards of Ed- 
ucation who responded to the Center's 
invitation, to those who read the 
manuscript and reacted, and to Larry 
Benedict, who helped with his discus- 
sions, I would like to express my 
thanks . 



Philip S. Saif, Director 
Project Evaluation 
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The concept of evaluation is a 
central concern to everyone involved 
in education. Educators have always 
been concerned with these five points 
of evaluation: Whu to evaluate, Hlhat 
to evaluate, Wjien to evaluate, Hoh to 
evaluate and Who to evaluate. Tradi- 
tionally, the concept of "evaluation" 
has been used interchangeably with 
that of "testing" and everyone is 
familiar with testing, beginning with 
the tests he took in first grade and 
continuing throughout his school 
career. 

Recently, however, many educa- 
tors have begun to feel that simple 
testing and test scores are not 
sufficient to meet education's needs 
or to make educational decisions* 
This booklet will focus on this con- 
cept and explore in more detail some 
of the topics of evaluation. 



The Purpos e of Evaluation 

Evaluation is done to collect 
specific information about a parti- 
cular enterprise to facilitate 
decision-making to enable the oper- 
ation of that enterprise to meet its 
goals. For example, an evaluation 
might be undertaken to see if an ex- 
perimental high school geography 
program is meeting its stated goals 



which ares (a) to teach more geog- 
raphy skills, (b) to teach map skills 
to slow learners, (c) to save money. 
When the program is in operation, in- 
formation (data) is systematically 
collected to see if the program is 
meeting its goals. If the geography 
course is supposed to teach map 
skills to slow learners, i6 it teach- 
ing map skills to slow learners? 

Once this information is col- 
lected, a decision or set of deci- 
sionii can be made about the program. 
If the data show that the slow learn- 
ers have mastered the required 
skills, a decision might be made to 
keep the program. If it were a pilot 
program, a decision might be made to 
expand it. Conversely, if the pro- 
gram failed to meet the expectations 
set for it, a decision might be made 
to modify it, or drop it entirely. 

The collection of information 
to make decisions about a particular 
program, a staff, an administrator, 
or even a School Board, is the pur- 
pose for doing any evaluation. Sys- 
tematic evaluation allows a decision 
maker or decision-makers (e.g., a 
School Board) ..to base decisions on 
data rather than on personal feel- 
ings, intuitions, or vague and 
general reviews by others. 

Evaluation can provide data to a 
School Board facing the following 



questions: 



1. About an administrator: Is the 
administrator doing the job he 
is supposed to be doing? Is the 
job being done well? Is the job 
being fulfilled in a manner con- 
sistent with the goals of the 
School Board J ^ of the community? 
Is the job being done the way 
the Board wants it to be done? 

2. About the Board itself: Is the 
Board doing the job it is sup- 
posed to be doing? Is it doing 
its job well? Is it accomplish- 
ing what it wants? Is it simply 
acting as a group? Is it opera- 
ting with consistency? Has the 
Board identified the job speci- 
fication of the Superintendent? 

3* About programs: Is a given pro- 
gram meeting its goals? Does an 
experimental program need a 
little more , a lot more , or no 
more support in order to work? 
Should the program be kept? Ex- 
panded? Modified? 



The purpo8«^ of evaluation in 
each "o7 the examples given above is 
to collect data which will help yield 
better decisions. In these cases the 
Board is the decision-maker, and in 
each case particular information is 



needed to make decisions. Informa- 
tion concerning an administrator 
would not be the same as information 
regarding a particular pA?ogram. 
Therefore, data must be collected 
giving precise information concerning 
points determined to be important. 



Some Basic Elements of Evaluation 



Whether evaluation is to collect 
data about programs, personnel, or 
some other aspect of an educational 
system, the evaluation will have car- 
tain basic elements. These elements 
can be phrased as questions, and the 
process of answering these questions 
comprises some of the basic steps of 
evaluat ion. 



Sttp 1 

Itihy l6 it nece44a/L(/ to havt 
e.\falacLtion7 

Any Board of education is making 
decisions. These decisions concern 
budget, personnel, and programs. In 
order that a Board can make sound 
judgments, relevant data must be pre- 
sented . 



{Dhat U to be zvataatzdl 

A clear definition of the enter- 
prise to be evaluated must be given. 
Is it a new program, the Superinten- 
dent, or a set of materials? Often, 
when asked what is to be evaluated, 
an educational decision-maker may re- 
spond, "tkz 6choot,'* or "thz tUmtn- 
taKy pfiogfiam," or "-tfie BnQlUh pfiO" 
gKam," A school, or an elementary 
program or an English program are 
comprised of many different elements: 
materials, students, personnel, etc. 
A clear definition of what is to be 
evaluated becomes the crucial start- 
ing point. 



SUp 3 

fofi u)kom l6 thz opzfLation oi an 
Q.ntzfLpfii6t to be tvataatzdf 

For any given enterprise, there 
are a number of decision-makers, each 
making different kinds of decisions* 
A Board makes different decisions 
about the Superintendent than does a 
faculty 5 therefore, each would want 
differei^t data for making their re- 
spective decisions* If the enter- 
prise were a new geography course, an 
evaluation could be done from the 



viewpoint of several different 
decision-makers: the teachers teach- 
ing it, the students taking it, the 
principal in whose building it is 
being implemented, the Board who 
authorized funds for it. 

An evaluation done for the 
teachers of the course would provide 
data for use in making instructional 
decisions* However, these data would 
not necessarily be useful for a 
School Board, which would be making 
decisions on a different level. Most 
traditional evaluations do not pro- 
vide for different decision— makers 
with different needs. Therefore, 
part of the evaluation process should 
be the identification of the various 
decision-makers and a determination 
of the primary decision-maker for 
whom the evaluation will be made. 



Stzp 4 

iDhat a/LZ the. goaU oi tht en- 

Once it has been determined 
what is to be evaluated and for 
whom it is to be evaluated, it is 
necessary to determine the goals 
held for the enterprise. Goal set- 
ting becomes an important part of the 
evaluation process* 
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BEST COPY AVAILABLE 

A math program cannot be evalua- 
ted unless the goals held for it are 
clearly specified. A Superintendent 
cannot be evaluated unless the goals 
of his job are clearly stated* In 
fact, a Board cannot evaluate itself, 
or determine if it is working satis- 
factorily, if it has not clearly 
stated its goals. 

Without identifying goals, it is 
literally impossible for a ii'ahool 
Board to evaluate effectively and 
systematically, its schools, its pro- 
grams, its personnel or its own oper- 
ation. One cannot determine whether 
something, or someone is doing well, 
if goals have never been identified 
and stated clearly and correctly. 

Unfortunately, goals tend to be 
expressed as vague concepts: ^good 

"^ood school 6U6tzm," " indlvldaat" 
izzd tzaKnlng*^ These goals are too 
general for meaningful data collec- 
tion. The decision-makers must take 
these goals and make them more 
specific. 

Decision-making by the Board is 
greatly hindered by the failure to 
identify and establish priorities on 
its goals. Without priorities, 
decision-making becomes a process of 
individuals acting intuitively and 
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inconsistently, leading to an atti- 
tude on the part of the community or 
the school personnel of, "Wztt, t/ohat 
u)iU thty do nextf" In the final in- 
stance, a Board is accountable to the 
community, but if the Board never es- 
tablishes concrete objectives, it can 
never say to the community that it 
has accomplished its purpose. 

It should be emphasized that the 
Board must actually identify its own 
goals. It is the Board's right, and 
indeed responsibility, to determine 
its goals as well as the uses to 
which data collected will be put. 



Step S 

(tikcn l6 zvatuation donzf 

Evaluation is a continuous pro- 
cess. Evaluation that begins and 
stops at a particular period of time 
is not a complete evaluation. An im- 
portant part of the evaluation is 
the feedback to the original goals or 
objectives to check whether or not 
such goals should be modified, de- 
leted, or left as they are. Evalua- 
tion must be a continuous process. 
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iioM U tvatuatlon pzKioH.mtd? 

This booklet is not intended to 
e3.aborate on this point. However, 
the various methods used in evalua- 
tfkons include: scales, lists, ques- 
tionnaires, opinionnaires , tests, 
video tapes, audio tapes, etc. This 
depends upon what is to be evaluated. 



Sttp 7 

What i6 dont with thz data? 

Decision-making. Once data are 
collected and presented a6 obj'^C' 
tiMtlij a6 po^iiblz, the decision- 
maker (s) (here they are the members 
of the Board) will make their de- 
cision(s}. The decisionCs) will be 
based upon the collected information. 

Caution must be vised related to 
decision-making. For example, if 
Board members came to a conclusion 
that the Superintendent should leave, 
t..is should not be interpreted that 
the educational programs he intro- 
duced are bad. Each component of the 
system must have its identity, even 
if there is an obvious relationship* 

The reverse is also true; i.e., 
a program that proved to be of no 

9 
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value in meeting the goals of educa- 
tion in a particular community does 
not necessarily mean thcvt the Super- 
intendent is bad (at fault). Appro- 
priate evaluation of personnel is a 
major task of a School Board. 



How to evaluate the Superinten- 
dent is one of the common problems 
facing Board members. One of the 
problems in Superintendent evaluation 
is that in too many cases goals for 
the Superintendent are not clearly 
and specifically set forth. 

When asked how he evaluates his 
Superintendent, one Board member re- 
plied that his yearly evaluation of 
the Superintendent is: "Gee, I think 
you CLKt doing a tfizimndoa6 job* I 
mnt to votz to Kzntw youH. contfiatt*" 

His ''evaluation" is based on 
feelings and emotions* or simply a 
matter of likes and dislikes » and he 
expresses his frustration with this 
approach. Decisions are often based 
on criteria such as being a neat 
dresser* being charming, not "rock- 
ing the boat." Needless to say, this 
is not a very systematic evaluation. 

10 
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Usually there are more sub- 
stantive goals held for the Superin- 
tendent. Such goals or criteria 
should be clearly stated, and every- 
one involved should be aware of them. 
Goals and standards of performance 
should be set by the Board, with the 
Superintendent . 



2. ?tfi6onnzt Bvatuatlon 



Personnel evaluation is another 
crucial element in the educational 
evaluation process* Like Superin- 
tendent evaluation, it has certain 
basic elements: "personnel" to be 
evaluated 5 goals for the personnel; 
objectives to meet the goals; and a 
decision-maker for whom the evalua- 
tion is made. 

Two issues arise, both from the 
perspective of Board members and 
from the perspective of teachers: 

(a) Who is responsible for per- 
sonnel evaluation, and 

<b) How is evaluation different 
from "rating." 

<a) Responsibility . Ultimately, in 
any public school district, the 

11 
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School Board is responsible for per» 
sonnel evaluation* However, there 
are other levels of responsibility 
involved in carrying out such evalua- 
tion: 

(1) The Superintendent t The Board 
will probably be directly re- 
sponsible for evaluation of 
the Superintendent. 

(2) Principals and administrators ; 
These persons are probably the 
direct responsibility of the 
Superintendent, It is reason- 
able for a Board to expect to 
be told the criteria which the 
Superintendent uses to evalu- 
ate principals and other ad- 
ministrators . The School 
Board, as a group, should know 
the criteria used to evaluate 
administrators. This does not 
mean that the Board needs to 
get involved in the evaluation 
of each staff member. It does 
mean that they should taKe 
some interest in establishing 
the goal setting phase of the 
evaluation process. 

reachers ; The Board should be 
expected to participate in the 
establishment of criteria to 
make teacher evaluation rel- 
evant to the goals of the edu- 
cational system. Failure to 
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do this invites a good deal of 
inconsistency into a system. 
This becomes obvious at con- 
tract time of year when a 
Board is usually presented 
with a list of names for ten- 
ure, rehiring or dismissal. 
Some Boai'^d members have ex- 
pressed frustration with such 
a process. They have raised 
such questions as: 

i))hat tfiitzKla wt/it a6e.d to 
make thtiz fizcomtmndatioM? 

A^e thty toMiAtznt viith tke, 
goaU oi thz school dihtKlttI 

AfLZ thzy con6i6tznt with nohat 
thz Socuid (/oant6? 

Each of these questions should 
be seriously examined and 
approved by the Board before 
an evaluation takes place. 



(b) E valuation as "rating "; One of 
the "most common complaints raised by 
teachers and administrators alike is 
that personnel evaluation is little 
more than a popularity contest, a 
"rating" based, at best, on very 
vague criteria. This implies that 
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the evaluation is not tied to any 
goals, but simply provides an index 
of comparison with respect to other 
teachers in the system, or with re- 
spect to the experience of the eval- 
uator. However, ratings could be a 
part of an on-going and systematic 
diagnostic evaluation process. 

Evaluation must be an on-going 
process. It cannot occur once or 
twice a year and have any real mean- 
ing. It must provide data from which 
decisions can be m&de in order to im- 
prove instruction. There must not be 
only one evaluation; rather a series 
of diFferent data collection tech- 
niques must be used by a variety of 
different people, possibly including 
the teacher himself. 

Answers to three questions — 
(ilhat iA to be 6.valuati.d, ^OK Mhom, 
and u)hat clM thz goai6 — form the 
first part of an evaluation. It is 
a crucial part and often overlooked. 
Once these three steps have been com- 
pleted, data collection begins. 



H ow are the da ta generated ? 

Once goals have been defined, 
there must be a design for data col- 
lection procedures, and a report to 
the decision-maker. Any evaluation 
would have these basic elements in 
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common. Judgments about the enter- 
prise, based on data, can then be 
made by the decision-maker. Since 
this is not a "how to" booklet, this 
topic will not be presented in detail 
here. 

A related issue has been raised 
by some Board members: How do tttc- 
tiont which thangt tht makz-up oi a 
ZodKd aUztt tht tducatlonal goalA 
htid by thz Boafidf 

Granted, a School Board election 
can greatly change the make-up of the 
committee: Two points should be made 
however : 

(1) Certain goals are unlikely to 
change » even with a new elec- 
tion. Such goals might in- 
clude: wanting children to be 
able to read, write, do basic 
computation, perform certain 
physical activities. In other 
words, even if a completely 
new committee is elected, some 
goals will remain the same. 
Once these goals have been 
clearly established, they are 
likely to remain unchanged, 
regardless of elections. 

(2) Some goals or priorities on 
goals are bound to change, 
even if Board elections do not 
change the make-up of the 
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committees. The Board should 
have a procedure for a per- 
iodic review of goals, regard- 
less of change. After all* 
educational goals are likely 
to change to a certain extent, 
simply because of changing 
times and attitudes. 



Should the Board members be involved 
in student evaluation ? — 

The Board should confine itself 
to drawing the policy, and leave the 
details to the professional educators. 
For example, the Board, upon gathered 
information, finds that using 
Criterion-Referenced Tests will be of 
more value than Norm-Referenced Tests. 
Therefore, a policy to use Criterion- 
Referenced Tests should be written 
and the Superintendent charged with 
implementing it. 



Conclusion 

Evaluation is meant to serve 
decision-makers by providing data to 
help them improve their decision- 
making. It is meant to help educa- 
tors determine how well they are 
doing something with the purpose of 
improving it; be it programs, per- 
sonnel, student learning, or Board 
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operation. Part of the overall 
purpose of improving education is im- 
proving its various parts or compo- 
nents • 



Given the increasing pressures 
on, and demands for resources i given 
the need for program and personnel 
accountability in the face of limited 
resources; evaluation has become an 
increasingly important decision- 
making tool * 
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